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Abstract 

Metros (heavy rail transit systems) are integral parts of urban transportation systems. Failures 
in their operations can have serious impacts on urban mobility, and measuring their robustness is 
therefore critical. Moreover, as physical networks, metros can be viewed as topological entities, 
and as such they possess measurable network properties. In this paper, by using network science 
and graph theoretical concepts, we investigate both theoretical and experimental robustness metrics 
(i.e., the robustness indicator, the effective graph conductance, and the critical thresholds) and their 
performance in quantifying the robustness of metro networks under random failures or targeted 
attacks. We find that the theoretical metrics quantify different aspects of the robustness of metro 
networks. In particular, the robustness indicator captures the number of alternative paths and 
the effective graph conductance focuses on the length of each path. Moreover, the high positive 
correlation between the theoretical metrics and experimental metrics and the negative correlation 
within the theoretical metrics provide significant insights for planners to design more robust system 
while accommodating for transit specificities (e.g., alternative paths, fast transferring). 
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1 INTRODUCTION 


With constant urbanization (United Nations, 2014), cities around the world are not only growing in 
number but they are also growing in size. As one of the main modes of urban transportation, public 
transit systems are integral to move people efficiently in cities (Vuchic, 2005). Indeed, they provide 
myriads of benefits, from reducing traffic congestion to having a lesser impact on the environment, 
emitting fewer greenhouse-gases per capita than the conventional automobile. The future of public 
transportation is therefore bright. While increasing transit use is desirable, effort must be put into 
developing designs that are also resilient and robust. These subjects have gathered much interest in 
the scientific community in recent years, especially within the context of resilience to extreme events 
(Ayyub, 2014; Cai et ah, 2014). Resilience typically refers to the ability to return to a previous state 
after a disruption, while robustness tends to measure the amount of stress that can be absorbed before 
failure. 

Traditionally, transit resilience and robustness have been associated largely with travel time relia¬ 
bility and variability (Levinson, 2005). It is still an important topic today from quantifying variability 
itself (Kieu et al., 2015; Mazloumi et ah, 2010) or its cost (Benezech and Coulombel, 2013), to using 
reliability and variability as a design criterion (Yao et ah, 2014; An and Lo, 2014). Recently, the field 
of Network Science (Newman, 2010) has emerged as particularly fitted to measure the robustness of a 
system, notably by studying the impact of cascading failure (Watts, 2002; Crucitti et ah, 2004; Kinney 
et ah, 2005). Indeed, as physical networks, metros are composed of stations (nodes) and rail tracks 
(links), and they therefore possess measurable network properties (Derrible and Kennedy, 2009; Derri- 
ble and Kennedy, 2010a) that can be used to study their robustness (Berche et ah, 2009; Derrible and 
Kennedy, 2010b; von Ferber et ah, 2012). Several works have also tried to combine information from 
both transit operation and network properties to gain insight into the robustness of transit networks 
(Rodrfguez-Nunez and Garcfa-Palomares, 2014; Kim et ah, 2015). 

In this work, our main objective is to define, use and compare multiple indicators and metrics 
to quantify the robustness of 33 worldwide metro systems within the realms of graph theory and 
network science. Metro, here, refers to heavy rail transit systems, whether underground, at grade, or 
overground. 

To assess the robustness of metros, our main research approach is to subject metros to random 
failures and targeted attacks. Three different metrics are used to compare the response of the metro 
networks to failures and attacks: (i) the robustness indicator r T , see (Derrible and Kennedy, 2010b), 
(ii) the effective graph resistance Rq , see (Van Mieghem, 2011) and (iii) the critical thresholds / 90 % 
and f c , see for instance (Cohen and Havlin, 2010). The first two metrics are analytical expressions 
available from the existing complex network literature, the critical thresholds are obtained through 
simulation. 

For this work, data from (Derrible, 2012) was used. In this dataset, only terminals and transfer 
stations are included as opposed to all stations. The other stations were omitted on purpose since 
they tend to bias the results by simply connecting with two adjacent stations. For more details on 
the data, the reader is referred to (Derrible and Kennedy, 2010b; Derrible, 2012). 
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2 ROBUSTNESS METRICS 


This section elaborates on the robustness metrics that are calculated in this study. Sequentially, we 
first introduce the robustness indicator r T , followed by the effective graph conductance Cq, and finally 
the critical thresholds / go % and f c . 

2.1 The robustness indicator r T 

The robustness indicator r T is suggested as a robustness metric for metro networks by Derrible and 
Kennedy (Derrible and Kennedy, 2010b). It quantifies the robustness of a metro network in terms of 
the number of alternative paths in the network topology divided by the total number of stations in 
the system: 


T ix-L m 
' - ~^S~ 


(!) 


where Ns is the total number of stations (not limited to transfers and terminals), L m is the number 
of multiple links between two nodes (e.g., overlapping lines), and /i is the cyclomatic number that 
calculates the total number of alternative paths in a graph; [i = L — N + P, with L the number 
of links, N the number of nodes, and P the number of subgraphs. Transit networks are typically 
connected and P = 1. The total number of stations, N$ in the denominator represents a likelihood of 
failure; i.e., the larger the system, the more stations need to be maintained, and therefore the more 
likely a station may fail. 

For this work, we do not consider any multiple edge£]. Moreover, we also use the number of nodes 
N (i.e., transfer stations and terminals) in the denominator as opposed to the total number of stations 
Ns- Equation Q] therefore becomes: 


rp L-N+l 

r = - 

N 

Essentially, r T increases when alternative paths are offered to reach a destination, and it decreases 
in larger systems, which are arguably more difficult to upkeep. 

2.2 The effective graph conductance Cq 

The effective graph resistance Rg captures the robustness of a network by incorporating the number 
of parallel paths (i.e., redundancy) and the length of each path between each pair of nodes. The 
existence of parallel paths between two nodes in metro networks and a heterogeneous distribution of 
each path length result in a smaller effective graph resistance and potentially a higher robustness level. 

The effective resistance Rij (Van Mieghem, 2011) between a pair of nodes i and j is the potential 
difference between these nodes when a unit current is injected at node i and withdrawn at node j. 
The effective graph resistance Rg is the sum of Rij over all pairs of nodes in the network. An efficient 
method for the computation of the effective graph resistance in terms of the eigenvalues is 

1 Even when two stations are directly connected by multiple lines, we assign a value of 1 to the adjacency matrix. The 
definition is given in Section T3.II 


3 





( 3 ) 


JV-l 


r g =nj: 


i =1 


hi 


where m is the ith non-zero eigenvalue of the Laplacian matrbo Properties of the effective graph 
resistance are given in (Van Mieghem, 2011). The effective graph resistance is considered as a ro¬ 
bustness metric for complex networks (Wang et ah, 2014), especially for power grids (Kog, Warmer, 
Van Mieghem, Kooij and Brazier, 2014; Kog, Warnier, Kooij and Brazier, 2014). In this paper, we use 
a normalized version of the effective graph resistance, called the effective graph conductance, defined 


as 


C G 


N - 1 
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where Cq satisfies 0 < Cq < 1. Here, a larger Cq indicates a higher level of robustness. 


( 4 ) 


2.3 Critical thresholds 

Critical thresholds relate to the fraction of nodes that have to be removed from the network, such 
that the size of the largest connected component of the remaining network is equal to a predetermined 
fraction of the size of the original network. Critical thresholds, which are also used in the percolation 
model (Newman et ah, 2002; Callaway et al., 2000), characterize the robustness of interconnection 
patterns with respect to the removal/failure of network nodes. 

In this paper, we first consider the threshold /g 0 %, the fraction of nodes that have to be removed 
such that the remaining network has a largest connected component that contains 90% of the original 
network. For the node removal process, we simulate both random failures and targeted attacks. In 
the case of random failures, the nodes are removed by random selection, while for targeted attacks, 
the nodes are removed progressively based on their degrees (i.e., stations with many connections are 
removed first). 

For the targeted attack, we also consider the critical threshold f c defined as the fraction of nodes 
to be removed such that the largest component is reduced to a size of one node (i.e., the network is 
completely disintegrated). Differently than the first two metrics, the critical thresholds /g 0 % and f c 
are obtained through simulations. 


3 EXPERIMENTAL METHODOLOGY 

The experimental method considers 33 metro networks and subjects them to failures or to deliberate 
attacks to determine their robustness. This approach can be used to evaluate the performance of 
different robustness metrics for metro networks under node failures/attacks. This section elaborates 
on the metro networks, attack strategies and the evaluation of robustness for metro networks. 

3.1 Metro Networks 

We define metros as urban rail transit systems with exclusive right-of-way whether they are under¬ 
ground, at grade or elevated. The physical metro network can be represented by an undirected graph 
2 An N x N matrix representing the graph. The definition is given in Section 13.11 
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G(N, L) consisting of N nodes and L links. As mentioned, the nodes are transfer stations and ter¬ 
minals, while the links are rail tracks that physically join stations. A graph G can be completely 
represented by an adjacency matrix A that is an A x JV symmetric matrix with element = 1 if 
there is a line between nodes i and j. otherwise a tJ = 0. The Laplacian matrix Q = A — A of G 
is an N x N matrix, where A = diag(dj) is the N x N diagonal degree matrix with the elements 
di = Ylf=i a ij- The eigenvalues of Q are non-negative and at least one is zero (Van Mieghem, 2011). 
The eigenvalues of Q are ordered as 0 = /rjy < Tn-i <...<// 1 - The degree di = a ij °f a node 

i is the number of connections to that node. The degree for the terminals is one. 

In this paper, we look at 33 metro networks. Figure UK shows the map of the Athens metro 
network^ and the graphical representation is shown in Figure |T)o. In Figure [Hr, stations 1 to 9 are 
respectively: Kifissia, Aghios Antonios, Attiki, Omonia, Monastiraki, Pireaus, Syntagma, Aghios 
Dimitrios, and Airport Eleftherios Venizelos. For more details on the methodology, see (Derrible and 
Kennedy, 2010b). 

3.2 Attack strategies 

To determine the robustness of metro networks, the response of metro networks to targeted attacks 
or random failures is investigated. This paper considers two strategies for node removal: (i) random 
node removal and (ii) degree-based node removal. 

• Random removal: The node to be removed is chosen at random from all the nodes in the network 
with equal probability. 

• Degree-based removal: The node to be removed has the highest degree in the network. If multiple 
nodes have the highest degree, one node is chosen at random from all the highest-degree nodes 
with equal probability. In this paper, nodes are removed progressively. We first remove the node 
with highest degree, and continue selecting and removing nodes in decreasing order of their 
degree. 

After a node is removed, the size of the largest connected component of the remaining network 
is determined. Measuring the size of the largest connected component for an interval of removed 
nodes [1, A] results in a robustness curve. According to the robustness curve, we then determine the 
critical thresholds /g 0 % and f c . The critical threshold /g 0 % is the first point at which the size of the 
largest connected component is less than 90% of the original network size. When determining the 
/ 90 % for random node removal, the size of the largest connected component is the average of 1000 
simulation runs. Similarly, the critical threshold f c is the first point at which the size of the largest 
connected component is one (i.e., the network is completely disintegrated). Figure [ 2 ] exemplifies the 
determination of the critical thresholds from the robustness curve in Tokyo metro network with 62 
nodes. Computing the size of the largest connected component for removed nodes from 1 to 62 results 
in a robustness curve. The size of the largest connected component is 56.77 after randomly removing 
4 nodes. After removing 5 nodes, the size becomes 55.48 which is smaller than 90% x 62 = 55.8, 
i.e., 90% of the size of the network. Therefore, the critical threshold / go % is determined as The 

Adapted from http://commons.wikimedia.org/wiki/File:Athens_Metro.svg 
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(a) The map of the Athens metro network. 



(b) The graphical representation of the Athens 
metro network 

Figure 1: Athens metro network 
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threshold f c is determined in a similar way. The critical thresholds are regarded as the experimental 
robustness level of metro networks with respect to node failures. 



Figure 2: The robustness curve for the Tokyo metro network 

4 NUMERICAL ANALYSIS 

In this section, we calculate and compare the results for the three measures discussed above. Firstly, the 
robustness metrics r T and Cq are computed for the 33 metro networks. Secondly, the critical thresholds 
of metro networks under random failures and targeted attacks are determined by simulations. Finally, 
the relationship between the three measures are compared and correlated. 

4.1 Effectiveness of robustness metrics 

Table Q] shows the values of the robustness metrics r T (column 3) and Cq (column 4) computed by 
equations ((2]) and Q for the 33 metro networks. 

According to the rank of the robustness indicator r T , the most robust network is Tokyo with 
r T = 0.74, followed by Madrid and Paris with r T = 0.67 and 0.62, respectively. Moreover, Seoul , 
Moscow and MexicoCity also have a relatively high robustness level. Clearly, the robustness indicator 
r T favors larger networks that have developed many alternative paths between any pairs of nodes. At 
the same time, r T discredits networks that have a high number of nodes while having few alternative 
paths. This is particularly exemplified by the case of New York. Due to the topography of the region, 
the New York metro lines run mostly North-South from the Bronx to Lower Manhattan and East- 
West in Queens and Brooklyn. The lines therefore seldom intersect as opposed to the case of the Seoul 
metro for instance. 

According to the effective graph conductance Cq, Rome with Cq = 0.25 has the highest robustness 
level, followed by Cairo and Marseille both with Cq = 0.17. The effective graph conductance not 
only accounts for the number of alternative paths, but it also considers the length of each alternative 
path. For smaller networks without cycles (e.g., star graph), the effective graph conductance increases 
due to the lower average path length between two stations. The topologies in Figure [3^ and Figure [3f> 
are particular examples. In this case, a higher effective graph conductance indicates a faster transfer 
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between two transit stations. At the same time, effective graph conductance favors networks with 
the smallest length of the shortest paths. Taking Figure [3h ( Montreal) and Figure ( Toronto) as 
examples, the difference between the topologies is that station 1 connects to 10 and then connects to 
station 3 in Toronto, while stations 1 and 10 separately connect to stations 2 and 3 in Montreal. The 
total length of shortest paths from station 1 to the rest of the stations is higher in Toronto than in 
Montreal. Compared to Toronto, the higher effective graph conductance in Montreal indicates that the 
effective graph conductance favors the star-like topology with a smaller average shortest path length. 

Both analytical robustness metrics, r T and Cq, therefore capture different aspects of metro network 
design. 



Figure 3: The topology of metro networks 



(d) Toronto 


Studying critical thresholds, Figure 0] shows the robustness level of metro networks, taking the 
Athens and London metro networks as examples, under random failures and deliberate attacks. The 
corresponding critical thresholds /g 0 % for targeted attacks (column 6) and random failures (column 
7), and f c for targeted attacks (column 8) are shown in Table [T] Column 7 and 8 in Table Q] show 
similar behavior of / 90 % for targeted attacks and random failures. 

Similar to the effective graph conductance Cq, Rome has the highest robustness level with / 90 % = 
0.20 both for targeted attacks and random failures. Cairo and Marseille have the second highest 
robustness level with / 90 % = 0.17 for both targeted attacks and random failures. On the other hand, 
and similar to the robustness indicator r T , an evaluation of the critical threshold f c shows that Seoul 
is the most robust network. It has a critical threshold f c = 0.59 indicating that 59% of nodes need to 
be removed before the network collapses. MexicoCity, Madrid, Barcelona and Tokyo are among the 
top 5 of the most robust networks. 

To further compare and correlate the three metrics, Table [2] shows the Pearson correlation p 
between the two robustness metrics and the critical thresholds in the metro networks. The high 
correlation between Cq and f 90 % for random failures and targeted attacks shows that Cq effectively 
captures the 10% failure of the metro networks under node removal. The high correlation between r T 
and f c shows that r T effectively characterizes when the network collapses under node removal. 

One explanation for the high correlation between r T and f c is that the robustness indicator r T and 
the critical threshold f c both characterize the number of alternative paths. However, r T and f c can 
not be completely correlated (i.e. p = 1) due to the scale-free properties in metro networks as shown 

4 In order to compare the topology of Montreal and Toronto, a link between stations 4 and 5 is added into Toronto 
and the effective graph conductance is 0.099. 



Table 1: Robustness metrics in 33 metro networks 


Networks 

N 

L 

T 

C G 

/ 90 % - Degree 

/ 90 %-R.andom 

fc 

Athens 

9 

9 

0.11 

0.11 

0.11 

0.11 

0.33 

Barcelona 

29 

42 

0.48 

0.03 

0.07 

0.03 

0.55 

Berlin 

32 

43 

0.38 

0.03 

0.09 

0.06 

0.53 

Boston 

21 

22 

0.1 

0.03 

0.05 

0.05 

0.38 

Brussels 

9 

9 

0.11 

0.11 

0.11 

0.11 

0.44 

Bucharest 

11 

12 

0.18 

0.1 

0.09 

0.09 

0.45 

BuenosAires 

12 

13 

0.17 

0.09 

0.08 

0.08 

0.33 

Cairo 

6 

5 

0 

0.17 

0.17 

0.17 

0.33 

Chicago 

25 

30 

0.24 

0.03 

0.08 

0.04 

0.44 

Delhi 

8 

7 

0 

0.12 

0.13 

0.13 

0.25 

HongKong 

17 

18 

0.12 

0.04 

0.06 

0.06 

0.47 

Lisbon 

11 

11 

0.09 

0.09 

0.09 

0.09 

0.36 

London 

83 

121 

0.47 

0.01 

0.07 

0.06 

0.51 

Lyon 

10 

10 

0.1 

0.11 

0.10 

0.10 

0.4 

Madrid 

48 

79 

0.67 

0.03 

0.08 

0.10 

0.56 

Marseille 

6 

5 

0 

0.17 

0.17 

0.17 

0.33 

MexicoCity 

35 

52 

0.51 

0.03 

0.09 

0.06 

0.57 

Milan 

14 

15 

0.14 

0.06 

0.07 

0.07 

0.43 

Montreal 

10 

10 

0.1 

0.11 

0.10 

0.10 

0.4 

Moscow 

41 

62 

0.54 

0.03 

0.07 

0.10 

0.54 

New York 

77 

109 

0.43 

0.01 

0.06 

0.04 

0.52 

Osaka 

36 

51 

0.44 

0.03 

0.08 

0.06 

0.53 

Paris 

78 

125 

0.62 

0.01 

0.08 

0.06 

0.53 

Prague 

9 

9 

0.11 

0.12 

0.11 

0.11 

0.33 

Rome 

5 

4 

0 

0.25 

0.20 

0.20 

0.2 

Seoul 

71 

111 

0.58 

0.01 

0.08 

0.08 

0.59 

Shanghai 

22 

28 

0.32 

0.04 

0.09 

0.09 

0.45 

Singapore 

12 

13 

0.17 

0.08 

0.08 

0.08 

0.5 

StPetersburg 

14 

16 

0.21 

0.07 

0.07 

0.07 

0.43 

Stockholm 

20 

19 

0 

0.02 

0.05 

0.05 

0.4 

Tokyo 

62 

107 

0.74 

0.02 

0.08 

0.06 

0.55 

Toronto 

10 

9 

0 

0.07 

0.10 

0.10 

0.4 

WashingtonD C 

17 

18 

0.12 

0.04 

0.06 

0.06 

0.35 
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(a) Athens 


(b) London 


Figure 4: Critical thresholds in metro networks under nodes removal 


in (Derrible and Kennedy, 2010b). Cq and r T therefore capture different aspects of metro networks, 
both of which are important for robustness. However, we should note that the correlation between 
Cg and r T is —0.68. 

These findings suggests that maximizing one of the two metrics likely decreases the other metric. 
This is therefore a major issue, which is not atypical of any robustness study. Indeed, while it is easy 
to develop design recommendations that can make a system more robust to certain conditions, it is 
much more challenging to develop recommendations that can make a system more robust overall. This 
point emphasizes the need to use multiple criteria when assessing the design of metro networks. It also 
points to the fact that robustness (and resilience more generally) are terms that are difficult to define 
and that cannot be solved with a simple objective function within an operations research context 
(Taleb, 2012). Instead, much work remains to be done to successfully come up with clear guidelines to 
transit planners, and simulation and network science may play an important part towards that end. 

Table 2: Pearson correlation p between robustness metrics r T , Cq and the critical thresholds. 


/ 90 % - Degree 

/90%- Random 

fc 

C G 0.89 

0.89 

-0.79 

r T -0.40 

-0.45 

0.85 


5 CONCLUSION 

The main objective of this work was to investigate the robustness of metro networks by defining and 
comparing three measures: (1) robustness indicator r T , (2) effective graph conductance Cq , and (3) 
critical thresholds /. The two first measures are analytical, while the last one is simulation-based. 
Moreover, for the critical thresholds /, we investigated cases when 90% of the network was still 
remaining, f 90 % (both under random failure and targeted attack), and when the complete network 
was disintegrated, f c (under targeted attack). 
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Overall, we find that both r T and Cq capture different aspects of the robustness of metro networks. 
The former focuses on the number of alternative paths, therefore favoring large networks, and the latter 
focuses on the length of the paths, therefore favoring small networks. Moreover, we found that the 
results for r T aligned closely with f c , while the results for Cq aligned closely with / 90 %. These results 
are somewhat problematic since the robustness indicators contradict each other. This finding simply 
points out the difficulty to account for and measure robustness in a holistic fashion, which therefore 
calls for more work on this topic so as to eventually help planners design more robust transit systems 
in this century of cities. 
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